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<N ; ABSTRACT 
O 

^ ' We present a deep 16.8 ks y-band image of the field of a candidate 2=10 

Qh' galaxy magnified by the foreground (z=0.25) cluster A1835. The image was ob- 

O ' tained with FORSl on VLT-Kueyen to test whether the V^-band lies below the 

' Lyman limit for this very high redshift candidate. A detection would unambigu- 

■ ously rule out that the source is at 2;= 10. The 3cr detection limit of the image 

in the area of the z = 10 candidate is Vab = 28.0 mag in a 2"-diameter aper- 
^ ' ture (about 3 times the seeing FWHM of O'.'T). No source at the position of the 

(73 ■ candidate galaxy is detected down to this limit. Formally, this is consistent with 

the ^-band probing below the Lyman limit in the rest-frame of a 2; = 10 source. 
However, given the recent non-detection of the object in a deep if-band exposure 
with NIRI on Gemini North down to //ab = 26.0 mag (3cr in a 1'.'4 aperture) and 
concerns about the detection of the reported associated emission line, it may be 
possible that this source is spurious. We discuss several astrophysical possibilities 
to explain the puzzling nature of this source and find none of them compelling. 

Subject headings: cosmology: observations - early universe - galaxies: distances 
and redshifts - galaxies: evolution - galaxies: formation 



^Based on Director's Discretionary time observations collected at ESO-VLT under program 273.A-5028(A) 
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1. Introduction 

Motivated by the discovery of high redshift, 2; ~ 6 quasars with what appeared to be 
Gunn-Peterson troughs (Becker et al. 2001; Djorgovski et al. 2001), many research groups 
began to search for the sources responsible for reionization (see e.g., Lehnert & Bremer 
2003; Bremer et al. 2004a; Stanway et al. 2004a,b; Bunker et al. 2003; Ajiki et al. 2003; 
Rhoads et al. 2003; Bouwens et al. 2004; Hu et al. 2004). The WMAP result of the 
surprising detection of a large Thompson electron optical depth of r = 0.17 ±0.04 (Kogut et 
al. 2003) and questions about whether the intergalactic opacity at z ~ 6 is due to the neutral 
intergalactic medium (IGM) or to discrete absorbers (e.g., Songaila & Cowie 2002) have led 
observers to try and push discovery techniques into the near-infrared (NIR) and beyond the 
redshift of the most distant Sloan quasars (Pello et al. 2004; Kneib et al. 2004). 

To reconcile the possible Gunn-Peterson troughs observed in high redshift quasar spectra 
and the WMAP resuhs, the fact that the ionizing photon density at high redshift appears to 
be dechning (e.g., Lehnert & Bremer 2003; Bunker et al. 2003) and the rapidly increasing 
density necessary to ionize the IGM at successively higher redshifts (e.g., Madau, Haardt, & 
Rees 1999) suggest that the universe may have had a complex reionization history. Indeed, 
these arguments led some researchers to propose complex models such as extended partial 
reionization (e.g, Madau et al. 2004; Ricotti & Ostriker 2004) or twice reionization (e.g., 
Cen 2003; Ciardi et al. 2003; Wyithe & Loeb 2003). In these complex scenarios, the 
discovery of even one high redshift star-forming galaxy provides powerful constraints on 
the sources of reionization and on how star formation proceeded in the early universe (e.g., 
Ricotti et al. 2004). 

But discovering galaxies at redshifts beyond 2; 6 becomes increasingly challenging. 
Rest-frame emission longwards of the Lyman limit is redshifted to observed A > 7500 A 
and the faintness of the galaxies makes them extremely difficult to detect. The essential 
spectroscopic confirmation is hampered by the dramatic increase in the density of telluric 
OH emission bands at A > 7500 A. There are regions 100 — 200 A wide that are relatively 
devoid of OH lines and narrow-band surveys for high redshift sources within these windows 
have been successful (e.g., Hu et al. 2004). Outside of these windows, even determining 
redshifts of color selected galaxies is generally very difficult at 2; > 6. 

One technique developed to overcome the difficulty of detecting the most distant galaxies 
takes advantage of gravitational lensing by an intervening galaxy cluster to boost the appar- 
ent brightness of background sources. This boost can be as much as a factor of 10 — 100 along 
the critical lines for lensing. Santos et al. (2004) proved the feasibility of this technique 
out to 2; = 5.6 and Kneib et al. (2004) discovered a probable lensed 2; ~ 7 Lyman break 
galaxy behind A2218. The efficiency of gravitational lensing assisted searches compared to 
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blank field searches is, however, sensitive to the slope of the luminosity function and thus its 
overall utility in finding large numbers of high redshift galaxies has yet to be assessed. 

Pello et al. (2004) reported the identification of a highly magnified galaxy lying on a 
critical line of the z — 0.25 cluster A1835 (which they denoted A1835-1916). Their data set 
included broad-band optical imaging from the B.ST and the CFHT along with NIR imaging 

and spectroscopy with ISAAC at the VLT. The object was undetected in the V. R, I optical 
bands, and only detected at 4(7 in H and So" in K. The J-band detection quoted by Pello et 
al. (2004) is formally an upper limit. The optical non-detection, the large break between 
the J and H bands, and the blue H — Kg color (i^AB — -^s.ab < 0) found by Pello et al. could 
possibly indicate a young galaxy at extremely high redshift. In their J-band spectroscopy 
Pello et al. reported an emission line at 1.33745 /xm, detected in two separate wavelength 
settings of the spectrograph and with a combined significance of 4 — 8 cr. The photometry, 
together with the lensing model suggesting the source lies on a caustic for very high redshift 
(with a magnification factor between 25 and 100 as being most likely), led Pello et al. to 
argue that the line is most likely Lya at 2; = 10.0175. Unfortunately, the signal-to-noise ratio 
of the spectrum is insufficient to show the telltale signature of the line profile asymmetry of 
highly redshifted Lja to rule out other line identifications. Given the uncertainties in the 
lensing model, the most important piece of evidence upon which the conclusion of 2; = 10 
rests is the shape of the spectral energy distribution (SED) measured from the imaging data. 

However, the high redshift nature of this source has been recently questioned. Based on 
new independent iJ-band data obtained with NIRI at the Gemini North telescope, Bremer 
et al. (2004b) did not detect the z = 10 candidate down to the 3a limit of Hab = 26.0 mag. 
This limit is 1 magnitude deeper than the 4(7 detection quoted by Pello et al. (2004) in 
their ISAAC data. This significantly weakens the main evidence for a redshift of 10, which 
relies on the strength of the break between the optical and J bands and the H band. The 
photometry no longer constrains the redshift and other identifications for the emission line 
from a lower redshift source remain possible. 

Before the Bremer et al. (2004b) results were obtained, we were awarded Director's 
Discretionary Time with FORSl at the VLT to conduct F-band imaging of the field around 

the z = 10 candidate and push the sensitivity to fainter levels than presented by Pello et al. 
(2004). A \^-band detection would be decisive: it would demonstrate beyond any doubt that 
the source is not at z = 10. Besides probing rest-frame wavelengths ~ 500 A for z = 10, 
well below the Lyman limit, we chose the V-band to reach within a reasonable observing 
time very sensitive limits compared to other optical or NIR bands and thus provide the best 
chance of detecting a reddened 2; = 1 — 2 object, which seems a likely alternative (see Bremer 
et al. 2004b). 
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2. Data and analysis 

2.1. Observations and Data Reduction 

The y-band observations of A1835 were carried out during Director's Discretionary 
Time on the nights of 2004 July 9, 16, and 19 (UT). We used FORSl on the VLT-Kueyen 
telescope in imaging mode with a projected scale of 0'.'200 pixel"^. Forty-eight separate 
frames of 350 s each were taken, for a total integration time of 16.8 ks. Half of the integration 
time was taken on 2004 July 16 and one-third on 2004 July 19, with only a small fraction 
(1/6) on 2004 July 9. The conditions were clear and the seeing was typical for the VLT in 
the optical, varying from 0'/5 to I'.'O with a median of about 0'/7. Each individual dithered 
exposure had a unique (non-redundant) pointing position, centered around the location of 
the z = 10 candidate. 

We reduced the data within IRAF as follows. We subtracted the bias from each frame 
using bias frames taken at the beginning and end of each night. We flattened each frame 
initially with flat field images produced by a combination of dithered sky images taken during 
twihght. From these bias-subtracted and flat-fielded images, we created a master sky flat 
by combining all of the dithered exposures of the target field, masking out all sources above 
1(7 of the average rms of each frame (the rms calculated including the whole frame). This 
flat was divided into each dithered frame. From the master sky flat, we also generated the 
bad pixel map used to exclude the bad pixels in each frame during the final combination. 
We determined the offsets between individual exposures by fitting the position of about 
30 bright, unsaturated stars. We co-averaged the reduced, registered frames using three 
different weightings: ^ (1) uniform weighting, (2) weighting by the seeing FWHM of each 
frame, which gives most weight to the frames with best seeing, and (3) weighting by the 
FWHM times the squared root of the average sky counts in each frame, which accounts for 
the rms noise within the seeing disk and optimizes for point-source detection. There is little 
variation in the sensitivity of the final images between the three different schemes. The latter 
two produce final combinations with the best FWHM of ~ O'.'T. For the analysis, we adopted 
the image combined following the third weighting scheme. 

To flux-calibrate the data we measured the photometric zero points using exposures of 
standard stars taken at the beginning and end of each night. We compared these measure- 
ments to zero points estimated throughout the month encompassing the range of observing 
dates. All zero points were in excellent agreement (within < 0.02 mag) and the final calibra- 
tion is based on the average measured by ESO during 2004 July when our data were taken. 



The weight w is apphed as multiphcative factor w 
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^ The average sky brightness in the final image is F = 21.5 mag arcsec ^, and varies among 
the individual frames by a few tenths of a magnitude. ^ 

2.2. Photometry 

Figure 1 shows the 20" x 20" region in our F-band image around the reported location 
of the candidate z — 10 galaxy. We do not detect any source at this position down to 
the faintest levels reached in our data. This implies a 3a limit of Vab > 28.0 mag in a 
2"-diameter aperture, as described below. ^ Our limit is 0.6 mag deeper than the 3a limit 
of Pello et al. (2004) given for a &!6 aperture, or about 3.5 mag deeper for an aperture of 
3 times the FWHM (0'.'76) of their l/-band data, assuming uncorrelated Gaussian noise. 

We assessed our ability to rehably set a meaningful upper limit to any possible source 
at the position of the z — 10 candidate using three different techniques. First we estab- 
lished the pixel-to-pixel rms variations in the background across the entire image. For this 
purpose, we used the Sextractor software (Bertin & Arnouts 1996). Sextractor estimates 
the local background level in a mesh grid over the image. These local background estimates 
are iteratively clipped until they converge to ±3a around the median of all meshes. The 
histogram of all remaining undipped pixels is then used to determine the rms variations of 
the background noise in the image. This procedure yielded an overall 3a detection limit 
of Vab — 27.6 mag in a 2"-diameter aperture. However, this limit is pessimistic because 
our image is very crowded with cluster and background galaxies at the depths reached: the 
surface density of faint sources is such that there is typically only about 4" between adjacent 
objects. Thus, the rms variations derived in this way partly reflect extended light profiles of 
the myriad of galaxies in the image. 

To obtain more realistic estimates of our detection limits in the area around the z = 10 
candidate, we focusscd our analysis to the region within ±20" of its reported location. We 
placed 30-60 apertures 2" in diameter all away from the outer light profile of any obvious 



^The ESO FORSl zero points are available at http://www.eso.org. 

■^Wc refer to the Vega photometric system when not explicitely indicating AB magnitudes. For the V 
band, the AB correction is very small, with Vab — VVega = 0.014 mag for FORSl accounting for the full 
system transmission. 

^This aperture size corresponds to 3 times the seeing FWHM in the combined data and has a negligible 
aperture correction except for the brightest point sources and the most extended objects. We note that it 
leads to conservative limits for faint point sources, for which the S/N is optimized with an aperture of 1.5 
times the FWHM. 
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object in this 1600 arcsec^ area. This procedure was repeated several times with differing 
numbers of apertures and positions to ensure that our final estimates were not critically 
dependent on the number of apertures or their exact placement. The average pixel-to-pixel 
rms within these apertures implies a Scr detection limit of Vab = 28.0 mag, with variations 
of ~ 0.1 mag between the apertures. The variation in the total residual flux within each 
aperture implies a Sa detection limit of Vab = 27.8 mag. 

To further determine the robustness of our detection limits, we placed 20 artificial point 
sources each at 3 different AB magnitudes, 27.6, 27.8 and 28.0, within ±20" of the reported 
location of the z = 10 candidate and avoiding all obvious sources in this region. The high 
degree of crowding limits the number of point souces that can be placed non-redundantly 
close to the position of the z — 10 candidate to about 20. We recovered the sources down to 
Vab = 28.0 mag at a rate similar to that expected for a 3(7 detection hmit (i.e. 50%), and 
the dispersion between the measured and true input brightness was ~ ±0.3 — 0.4 mag. Given 
the excellent agreement between the two most robust methods, we adopted Vab = 28.0 mag 
as the detection limit in a 2" aperture at the position of the z — 10 candidate. 



3. Discussion 

The non-detection in our VLT FORSl band data down to a faint limit has im- 
phcations for the nature of the source investigated by Pello et al. (2004). Formally, a 
non-detection is consistent with the candidate having a redshift of 10. The BcsscI V band 
filter has an effective wavelength of 5540 A and half maximum transmission at about 5000 
and 6000 A. For z = 10, these wavelengths correspond to 500 A and the range ?a 450 -550 A 
in the rest-frame — well below the Lyman limit and completely opaque. The lower limit 
to the redshift, if the V-band non-detection is caused solely by the IGM opacity below the 
Lyman limit, is ~ 5.6. However, there is substantial opacity within the Lyman forest at 
these redshifts and thus y-band Lyman break or drop-out galaxies have redshifts that are 
usually less than this (see e.g., Bremer et al. 2004a). 

Although our V-band non-detection may allow for z > 5.6, or even z = 10, this is not 
the only interpretation possible in view of other lines of evidence that have recently come 
to light. There are certainly two other hypotheses that are equally plausible, and perhaps 
significantly more likely. 

The strongest evidence for the ^ = 10 interpretation presented by Pello et al. (2004) 
relied on the large break among the optical, J, and H bands, and the subsequent detection 
of an emission line at 1.33745 /im. However, this evidence has now been called into question. 
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Bremer et al. (2004b) did not detect the candidate object in their new independent and 
1 mag deeper if-band image from NIRI down to i^AB = 26.0 {3a). This greatly weakens 
the argument based on the break strength (as well as the blue H — Kg color) that supported 
the claim for the emission line being Lja at z ^ 10. Furthermore, Weatherley et al. (2004) 
have recently questioned the robustness of the line detection. However, this was based on 
a re-analysis of the spectroscopic data used by Pello et al. (2004) and subtle differences in 
reduction techniques could lead to contentious results. It is probably reasonable to conclude 
that the significance of the hue is difficult to judge. 

If the object is not at a redshift of 10, then what could it be? One way forward is to 
assume the reality of the line, use the sensitive i^-band limit of Bremer et al. (2004b), 
and assume an alternative line identification to determine if the emission properties are 
reasonable for a galaxy at a lower redshift. Bremer et al. argued that the source could be 
a dwarf/HII galaxy at intermediate redshift and that lines such as the [O II]AA3726, 3729 
doublet, [O III]A5007, or Ha at 1.0 < ^ < 2.6 are the most likely alternatives to Lya. 
If it were [O III], then the line width and luminosity would be consistent with the local 
relationship for dwarf/H II galaxies between these quantities (e.g., Melnick, Terlevich, & 
Terlevich 2000). In light of our new y-band results, we wish to further this argument. 

Assuming the line is [O III] at z = 1.67 and adopting reasonable cosmological parameters 
{Ho = 70km s^^ Mpc~^, fim = 0.3, and = 0.7), our V^-band limit implies an unlensed 
absolute magnitude fainter than —16.4 mag at 2080 A. Since there is no published detailed 
analysis of the mass model of the intervening cluster, it is difficult to quantitatively assess the 
magnification factor for z = 1.67 (Pello et al. suggested a magnification factor of between 
25 and 100 for a source Bit z — 10). Conservatively, we assume no lensing; lensing will only 
make the source intrinsically fainter. The co-moving density of galaxies in the local universe 
with absolute magnitude —16.5 at 2000 A is 02ooo ~ 10~^"^ Mpc~^mag~^ (Treyer et al. 
1998). The number of such sources on the sky with 1.45 < z < 1.95 is then ^ 50 arcmin"^ 
if the UV luminosity function does not evolve out to z = 1.7. The luminosity function of 
z ^ 3 Lyman break galaxies implies a roughly similar surface density for such faint objects 
(Steidel et al. 1999). Comparable densities would be inferred to a factor of ~1.5 if the line 
were Ha at z = 1.04 or [O II] at z = 2.59. 

The surface density of sources down to the detection limit of our image is >50 arcmin"^ 
(modulo the incompleteness). Therefore the probability of finding and perhaps even mistak- 
ing it for a very high redshift source is consequently high. The immediate explanation is that 
the source might simply be fainter. However, this poses problems when trying to reconcile 
the broad-band flux limits with the reported emission line flux. 

The 3a H-hand limit obtained by Bremer et al. (2004b) coupled with the line flux 
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given by Pello et al. (2004) implies an observed equivalent width (EW) of Wohs > 170 A 
(assuming a fiat f^, continuum between 1.65 and 1.34 /im; if the source were redder [bluer] 
as suggested by Bremer et al. , the EW limit would be higher [lower]). Assuming the line 
is [O III] at z = 1.67, the corresponding rest-frame EW is PKest ^ 60 A. For the alternative 
case of Ra at z = 1.04, W^cst > 80 A, and of [O II], W^est > 45 A. Locally, such large EWs 
are only found in galaxies with low metallicity and blue colors (Sullivan et al. 2000). 

Although the Bremer et al. H-hand limit sets a reasonably stringent lower limit on 
the EW of the line, our y-band limit may provide an even stronger constraint. Locally, 
sources with large emission line EWs are very blue, with UV — B colors always bluer than 
for a flat spectrum (Sullivan et al. 2000). For sources at z 1.7 this implies observed 
Vab — Hab ^ 0. Supposing again the source is at z = 1.67 and assuming conservatively it has 
a fiat f„ spectrum, our limit of Vab > 28.0 mag implies an if-band hmit of Hab > 28.0 mag 
and, repeating the reasoning above, a rest-frame EW for [O III] of VFrest > 400 A(>500 A 
if HcK, >300 A if [O II]). For a bluer spectrum as observed locally, the line EW limit only 
increases. A similar argument would apply to any other optical line. Such high EWs are 
rarely observed, would require a very young age (< 10 Myr) and perhaps an initial mass 
function heavily skewed toward massive stars. 

Summarizing the above arguments, our sensitive K-band limit implies a faint intrinsic 
UV (~ 2000 A) absohite magnitude. Plausible luminosity functions predict a high surface 
density of such objects and thus a high probability of detection if the source were just bright 
enough to match the 3cr limiting magnitude of our V-band image. No object is detected 
at the expected location despite the high density > 50 arcmin^^ of 3 — 4cr sources in the 
data. Postulating then that the object could be fainter, the lower hmits on the rest-frame 
EW of the emission line become very large and the probability of detecting such a source 
becomes very low. Thus, in view of the simple astrophysics of line emission, the scenario of an 
intermediate redshift dwarf does not appear very likely given the difficulties in reconciling the 
broad-band limits with the emission line flux. Additionally, although largely circumstantial, 
the arguments could perhaps cast doubt on the reported line flux (Weatherley et al. 2004). 

The other possible scenario is that the source may be transient or variable. The NIR 
ISAAC images and spectra presented by Pello et al. (2004) were taken in 2003 February 
and late June to early July, respectively. The NIRI if -band data were collected during two 
nights in 2004 late May and early June. The K-band data discussed here were obtained in 
2004 mid- July. Overall, these observations span a period of about a year and a half. 

Given the ecliptic latitude of the A1835 field at about 14°, one hypothesis could be that 
the source is a solar system object with a large proper motion. The tightest constraint comes 
from the time over which all of the Pello et al. (2004) ISAAC if-band data were taken. 
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The observations were carried out over 24 hours on 2003 February 15 and 16 and the seeing 
in the final if-band image is ~ 0'/5. Conservatively, for the source not to appear extended 
would imply an angular velocity of < 0'/5/24 h or < 0'.'02h~^. If the source is bound to the 
Sun and consistent with a distant object like Pluto, for example, with a tangential velocity 
of 5 kms~^, it would lie at more than D=1240 AU. To be unresolved in the O'.'S H-hand 
image at the distance derived from the proper motion limit, the source would have to be 
smaller than ~ 10 Jupiter diameters. The brightness of an object illuminated by reflected 
sunlight and assuming an albedo of one, is related to its angular diameter, 9, by m = m© - 
5 log(^/2D). Prom the size calculated above the source would have H ^55 mag. An object 
with the magnitude as claimed by Pello et al. (2004) would have to be a miUion times larger 
than what wc roughly estimated and thus would violate the size constraint by 6 orders of 
magnitude. It is possible to relax these constraints by an order of magnitude, but even given 
more optimistic estimates, a solar system object seems highly unlikely. 

It is more difficult to estimate the probably that the source is a high redshift supernova, 
7-ray burst or perhaps something more exotic (e.g.. Stern et al. 2004, and references 
therein). Dahlen et al. (2004) determined a SN rate of about 5.5 x 10~^ SN yr~^ Mpc^^ 
at < z >Ri0.7-0.8 and using a model for the star- format ion rate density evolution, they 
estimate about a factor of 2 increase in the SN rate at zpa2. The magnitude at which Pello 
et al. claim to have detected the source is Hab — 25.0. It is difficult to know what the 
redshift of the source might be, especially since the photometry for a transient provides 
no constraints on the redshift. It is worth noting that distant SNe generally have optical 
magnitudes fainter than the Pello et al. detection (e.g., Stolger et al. 2004; Dahlen et al. 
2004) and given the relatively blue SED of SNe this means that the 2;= 10 candidate would 
have been one of the brighter SNe (it is of course magnified by an unknown amount which 
could account for its relative brightness). At any rate, we can estimate the chances of finding 
a SNe scrcndipitously in their field. Assuming that the SN was caught within 30 days of 
its peak, that the redshift range of the SN was 0.5-1.0 (roughly consistent with the range in 
Dahlen et al. 2004), and that the area in the detection image was 6 arcmin^, we would have 
expected 0.22 SN in the field based on the Dahlen et al. (2004) SNe rate density. Thus 
the candidate as an intermediate redshift SN cannot be ruled out. However, this is surely 
optimistic given the magnitude of the detection claimed in the Pello et al. iJ-band image 
and the unknown magnification. Lensing would decrease the probability by decreasing the 
effective area sampled. Requiring the SN to be observed more closely to its peak in order 
make detection more likely would (linearly) lower the relative probability of observing it. 

Neither of the transient hypotheses can explain the line detection. One would have to 
postulate that it comes from the host galaxy in the case of a SNe from which there has been 
no subsequent continuum detection. Given the EW arguments we made previously, this 
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would have to be a very unusual object to escape detection. For a solar system object, the 
gap between the dates of the imaging and spectroscopy means that the source would have 
moved a significant distance from the discovery position and not within the subsequent slit 
spectroscopy. Therefore, none of the possible transient hypotheses explain simply or logically 
all of the claims in Pello et al. (2004). Given the if-band non-detection of the source down 
to faint limits by Bremer et al. and now in the V-band, and, the unlikely nature of any 
galaxy with the properties (lower-limits) observed, it is tempting to conclude that the most 
likely explanation is that the source is spurious. 

We would like thank the referee, Pat McCarthy, for his comments, and Roser Pello 
and Daniel Schaerer for their arguments and insights. We wish to thank the ESO DG, 
Gatherine Gesarsky for the generous allocation of observing time and Bruno Leibundgut for 
his curiosity and support. We are grateful to the ESO USG, DMD, and Paranal staff for 
conducting these observations, Mario van den Ancker and Roberto Mignani, in particular, 
for their dedication and effort. 
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Fig. 1. — Deep F-band FORSl image of the region around the z—10 candidate object 
reported by Pello et al. (2004). The image is approximately 20" x 20" with seeing of ~ O'.'T. 
The circle indicates the location of the candidate object, and is 2.0 arcsec in diameter. 
There is no evidence for emission from the candidate in the V-band down to a 3(7-limit of 
Vab = 28.0 mag. 



